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Abstract: We give the distribution function of M n , the maximum of a sequence of n 
observations from an autoregressive process of order 2. Solutions are first given in terms 
of repeated integrals and then for the case, where the underlying random variables are 
absolutely continuous. When the correlations are positive, 

P(M n <x)= a n)X , 

where 

oo 
3=1 

where {i>j x } are the eigenvalues of a non-symmetric Fredholm kernel, and v\ x is the eigen- 
value of maximum magnitude. The weights f3j X depend on the jth left and right eigenfunc- 
tions of the kernel. 

These results are large deviations expansions for estimates, since the maximum need 
not be standardized to have a limit. In fact such a limit need not exist. 
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1 Introduction and summary 

Many authors have considered extreme value theory for moving average processes, see 
Rootzen (1978), Leadbetter el al. (1983, page 59), Davis and Resnick (1985), Rootzen 
(1986), O'Brien (1987), Resnick (1987, page 239), Davis and Resnick (1989), Park (1992), 
Hall (2002), Hall (2005) and Kliippelberg and Lindner (2005). However, the results either 
give the limiting extreme value distributions or assume that the errors come from a specific 
class (e.g. integer- valued, exponential type, heavy tailed, light tailed, etc). We are aware 
of no work giving the exact distribution of the maximum of moving average processes. 
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This paper applies a powerful new method for giving the exact distribution of extremes 
of n correlated observations as weighted sums of nth powers of associated eigenvalues. The 
method was first illustrated for a moving average of order 1 in Withers and Nadarajah 
(2009a) and an autoregressive process of order 1 in Withers and Nadarajah (2009b). 

Let {ej} be independent and identically distributed random variables from some distri- 
bution function F on R. We consider the autoregressive process of order 2, 

Xi = a + ri*i_i + r 2 Xi- 2 . (1.1) 

We restrict ourselves to the case where 

rx > 0, r\ + r 2 > 0. (1.2) 

This includes the most important case, r\ > 0, r 2 > 0. (When this condition does not hold 
the method can be adapted as done in Withers and Nadarajah (2009b).) In Section 2, we 
give expressions for the distribution function of the maximum 

M n = maxXj, n > 1, 

i=l 

in terms of repeated integrals. This is obtained via the recurrence relationship 

G n (y) = K,G n - 2 (y), y = (y ,yi), n>2, (1.3) 

where 

G n {y) = P{M n < x, X n < y , X n ^ < y x ), (1.4) 
Kr{y) = E j r(g y (z 1 ,ei,e Q ),dz 1 ), (1.5) 
g y (z 1 ,e 1 ,e ) = mmgj, 

3=1,2 

9i = (Vox - e - nei - rir 2 zi)/(r\ + r 2 ), g 2 = (yi x - e\ - r 2 z 1 )/ri, (1.6) 
y ix = min(yi,x), (1.7) 

1(A) = 1 or for A true or false and dependency on x is suppressed except in y^ x . So, K, is 
a linear integral operator depending on x. For (|1.3jl to work at n = 2 we define Mo = — oo 
so that 

G (y) = P(X < y ,X^ < m ) = H(y) say. (1.8) 

In Section 3, we consider the case when F is absolutely continuous with density f(x) 
with respect to Lebesque measure. In this case we show that corresponding to /C is a 
Fredholm kernel K(y, z). We give a solution in terms of its eigenvalues and eigenfunctions. 
This leads easily to the asymptotic results stated in the abstract. 

Our expansions for P(M n < x) for fixed x are large deviation results. If x is replaced by 
x n such that P(M n < x n ) tends to the generalized extreme value distribution function, then 
the expansion still holds, but not the asymptotic expansion in terms of a single eigenvalue, 
since this may approach 1 as n — >• oo. 

For a, b functions on R 2 , set J a = f a(y)dy = f R2 a(y)dy and similarly for j ab. 
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2 Solutions using repeated integrals 

Theorem 2.1 G n of ( fi.^p satisfies the recurrence relation hi. Sty in terms of the integral 
operator JC of tl.5\) . 

Proof: Set 

c y (X,e) = mm((y 0x - e - r 2 X)/r 1 ,y lx ). 
For n > 1, G n of (|1.4p satisfies 

G„(y) = P(M n < x, X n < y 0x , X n _ x < y la; ) 

= P(M„_i < x, e n + riX n _i + r 2 X n _ 2 < Vox, X n -\ < y lx ), n > 1, 

= P(M n _i < x,X n _i < c J/ (X n _2,e„)) since r 1 > 

= P(M n _ 2 < + riX n _ 2 + r 2 X n -3 < Cj / (X n _ 2 , e„)), ra > 2, 

= P(M n _ 2 < a^,^n-2 < 5j/(^n-3,e n _i,e n )) = JCG n - 2 (y)- 

So for n > 2, (|1.3p holds. This ends the proof. □ 

Our goal is to determine u n = P(M n < x) = G n {oo) where oo = (oo,oo). Our next 
result gives these in terms of 

a n = [JC n H(y)] y=00 , b n = [JC n H (y 0x , yi )] y=00 , n > 0. 

For example, 

a = l,a 1 = E J H(g oo (s,ei,e ),ds), 

b = H(x, oo) = P(X < x), b\ = E J Gi(g oo (s,e 1 ,e ),ds), 

where 

9oo(s,ei,e ) = min{(x - e - nei - rir 2 s)/(rj + r 2 ), (x - a - r 2 s)/r 1 }. 



Theorem 2.2 

u 2n = a n , u 2n -i =b n , n> 0. (2.1) 

Proof: by Theorem 2.1, for n > 

G 2n (y) = IC n G (y), G 2n+1 (y) = K. n Gx(y). 

Also 

G (y) = H(y), G^y) = H(y 0x , yi ). 

Putting y = oo gives (|2.ip . □ 
Note that 

G 2 (y) = H(y 0x ,y lx ). 
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3 The case of F absolutely continuous 



Our solution Theorem 2.2 does not tell us how u n behaves for large n. Also calculating a n 
requires repeated integration. Here we give another solution that overcomes these problems, 
using Fredholm integral theory given in Appendix A of Withers and Nadarajah (2009a), 
referred to below as "the appendix" . 

Theorem 3.1 Suppose that F has first and second derivatives f and /.i. Suppose that 

7 y (z)r(z) — > as Z\ — > ±oo (3.1) 

where z = (z , zx), 

7y0) = (n + r 2 /r 1 )-f yl (z) + nj y2 (z), 



7yi( z ) = / f(cy(w ,z))f(w )dw , 

Py( w o) = (vox - nyix - w )/r 2 , 

Cy(w Q , z) = [y 0x - r 1 r 2 z 1 - (rf + r 2 )z - w ]/n, 
ly2(z) = f(yi x ~ r 2 zi - nz ) F(5 y (z )), 
dy(z ) = yox ~ nyi x - r 2 z . 

Then we can write \1.5]) in the form 

Kr(y) = J K(y,z)r(z)dz (3.2) 

where 

K(y,z) = (n +r 2 /ri)r 2 / f(ax(w , y, z))f(w )dw + nr 2 F(5(z ))f.i(a 2 (y, z)), 



ai(w ,y,z) = [y 0x - (rf + r 2 )z - r x r 2 z x - w ]/n, 
a 2 (y,z) = y lx - t\Zq - r 2 Z\. 

PROOF Set 

hy(eo,Zi) = [(rf + r 2 )y lx - r x y$ x + ne - r\zx\jr 2 . 

Then for gi of (fOjh 

9i < 92 ei < h y (e ,zi). 

So 1Cr(y) = 1% + I 2 where 



h = I f(wx)dwi / f(w )dw I r(gi,dzx), 

' wi<h y (wo,zi) 



h = rx f(wx)dwx / f(w )dw / r(g 2 ,dzx), 

J Jg%>Py{via) J 

since rx/3 y (w ) = y lx - r 2 zx - h y (w , z\). 
Also g\ = Wx Wx = c v {wq, z\, gx)- So transforming from gx to zq, 

h = f(w )dw / A(w ,zx) 
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where 



/•OO rPy(wo) 
A(w ,zi) = / dw 1 f(wi)r(z ,dz 1 ) = (n +r 2 /r 1 ) f(c(w ,z))r(z ,dzi) 

Jh„(wn,zi) J 



ih y (w ,zi) 

So h = (r 1 + r 2 /r 1 ) I dz I r(^,(tei)7 sl (z). 



Also 



h y (w ,zi) 

dw f(w ) I I dwir(g 2 ,dz 1 )f(wi) 



where r\g 2 = y\ x — w\ — r 2 z±, that is, w\ = y\ x — r 2 z\ — r%g 2 . So transforming from g 2 to 

h=n / dw f(w ) / / dz f(yi x - r 2 zi - riz )r(z) = n / dz / -f y2 (z)r(z ,dzi). 
J J J p(w ) J J 

So fCr(y) = I\ + I 2 = J dg f r y y (z)r(zQ,dzi). Integrating by parts, ([3.ip gives 



Kr(y) = J j y (z)r.i(z)dz = J K (y,z)r(z)dz 

where r.i(z) = —{d/dz\)r{z) and Ko(y,z) = —'fy.x(z) = —(d/dzi)jy(z) by Also 
Ko(y, z) = K(y, z). This ends the proof. □ 

We now assume that 

0< / K(y, z)K(z,y)dydz < oo. (3.3) 



So K(y, z) is a (non-symmetric) Fredholm kernel with respect to Lebesgue measure, allowing 
the Fredholm theory of the appendix to be applied, in particular the functional forms of 
the Jordan form and singular value decomposition. 

Let {Xj,rj, lj : j > 1} be the eigenvalues and associated right and left eigenfunctions of 
K. ordered so that |Aj| > |A J+ i|. If {A^} are real then {rj,lj} can be taken as real. By the 
appendix referred to, these satisfy 



= ^i r i' = A i^' J r 3 l k = J 2 rj{y)h(y)dy = 5 jk , 

where Sjj. is the Kronecker function. So, {fj(y),lk(y)} are biorthogonal functions with 
respect to Lebesgue measure. 

We now assume that 

K(y, z) has diagonal Jordan form. (3-4) 

(This holds, for example, when the eigenvalues are distinct. This will generally be the case 
for our applications.) The functional equivalent of the Jordan form is, by (3.6) of Withers 
and Nadarajah (2008b), 

oo 

K(y,z) = ^2X j r j (y)l j (z). 
3=1 
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This implies that 

oo 

K n (y,z)=lC n - 1 K(y,z)=Y,^r ] {y)T J {z) 

3=1 

where /C n is the operator corresponding to the iterated kernel K n (y, z). By (A. 8) of Withers 
and Nadarajah (2009a) with // Lebesgue measure on R 2 , if KG is in L 2 {R 2 ) then 

oo 

IC n G(y) = r M X l n >^ ( 3 - 5 ) 

where Bj(G) = f R2 Glj. Putting y = oo and G = Go, G\ in (|3.5|) gives 
Theorem 3.2 Suppose that i TO)) {gg j /joW. T/ien /or £j o/ |gT5j) and n > 1 

oo oo 

a n = ^(oo^i^A?, & n = Y,r J (oo)B J (G 1 )X]. 

i=i i=i 

Corollary 3.1 Suppose that the eigenvalue X\ of largest magnitude has multiplicity M. 
Then under the assumptions of Theorem 3.2, 

a n = B(H)X r {(l + e n ), b n = B(Gi)X±(l + e n ), n > 1, (3.6) 

where e n — > exponentially as n — > oo and 

M 

B{G) = Y,r 3 (™)B 3 {G). 

3=1 

So, for n > 1, by (OOP 

u 2n = B(H)\ r i(l + e n ), u 2 n+i = #(Gi)A?(l + e„). 



3.1 A numerical solution 

We now give a numerical method for obtaining the eigenvalues and r-j(oo) and Bj(G) needed 
for Theorem 3.2. 

Consider the jth eigenvalue and eigenfunctions A = Xj, r = rj, I = lj. The right and 
left eigenfunctions satisfy 

Ar = /Cr, XI = IJC, 

that is 

Xr{y) = K,r{y)= f K(y, z)r(z)dz, Xl(z) = T{z)K = f l(y)K(y, z)dy. (3.7) 

Let us approximate an integral over R 2 by by Gaussian quadrature (see for example Section 
25.4 of Abramowitz and Stegun (1964)), say 
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where {z\, ■ ■ ■ ,z r } are given points in B? and {w\, ■ ■ ■ ,w r } are given weights. Let R, L 
denote the r-vectors with kth elements r(z k ),l(z k ). Let K denote the r x r matrix with 
(i,j)th element K(zi,zj). Then we can write (j3.7|) as 

AR fa KR, AL rj LK. 

So to this order of approximation, the eigenvalues are just those of K, and r(z k ),l{z k ) are 
just the kth. elements of the right and left eigenvectors of K corresponding to A. 

Also 

r(oo) = A -1 / K(oo, z)r(z)dz « A -1 ^ w k K(oo, z k )r(z k ) 

k=l 

and ^ 

B 3 (G) = [ Gl 3 « V w k G{z k ) Ij (z k ) . 
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